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ABSTBACT . * ' , « 

• Bithin aptitude areas (Mechanical, Adainistrative, 
dei^Ml, 0^ Blectronici in the Air Force, soae technical schools 
dsfuir^^'hi^ber levels 'of aptitude for adaission than do others (for 
exaaple, there are aio' schools, 660 schools, and 660 schools based on 
Oenecal .test scores in th lOtb, 60th, end BOth .percentiles 
respectii^elrl • The schools, hosevert gi*e grades on a scale f roa 70 
to 100, regardless of the difflcnlty of the school curricalua. This 
setBi that a score of 82 in a. 6«it> school is recorded the saae as an 
02 it a 680 school although th«[ scores in a 680 school aust indicate 
a higher level. of perforaance than the sane score does In the 610 
school. This stttd^ is an. evaluation of a aethod of adjusting 
t^jehtlail school grades issued by schools of varying difficulty so 
ith^*i a aev criterion is foraed vith all school grades adjusted to the 
saae aetric. Tbi's neir criterion, was then used to recoapute aptitude 
indexes, vhicti' vote coapared with aptitude^ indexes coaputed in the 
eesvMtioaal aaaaer. The aev aptitude indexes predit;ted school grades 
in t cross-^val^ldation saaple better than did conventional aptitude 
iadeiits. (Author/BB) ; ^ ' 
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, PREFACE 

Thii fludy was omducted under Twk 771918, Selection and au^ricaUon Technologies. The 
mearch focuaec on the deireli^ment of procedures and techniques to refine and improve 
measurement devices used in tl^ Air Force operatiimal testing program. 

This w<wk represents an attempt to refine the aptitude indexes of the Armed Services 
* Vocational ^tude Battery (ASVAB), thereby improving their predictive accuracy and 
consi^quently the utOity of selectioii measures. This ef fwt supports the subthrust area Assesonept of 
Personnel Qualifications, under the major thrurt area of Mappower and Fwce Management 
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y . WEIGHTING OF APTITUDE COMPONENTS BASED ON DIFFERENCES 

IN TECHNICAL SCHOOL DIFFICULTY ' 



; I. BACKGROill^ ANf> imilODIjCTION 

The use irf the <^ei«l aptitude battery (called by varioua names over the past three decades) for 
selection and classification of Air Force enlisted personnel has always taken the form of compaution and 
interinreUtion of four or moi^ AptUude Indexes (AIs) (Weeks, Mullins, A Vitola, W5). The use of A|s 
appeared in the first Ahr Fotce apt;tude battery (AC-lA). It was not administratively feasible in 1948 to 
{NToduce a unique cimipoaite score for eadi Air Force j<d), but it was assumed that differential aptitude 
compoaites were desirable. Job clusters were developed on the basis of subjective judgment and job 
analyrn data. Thmugh study of test results, sdentikU fomed clusters of tesU (AIs) whkh were leasonably 
homogeneous inU mally and' predictive of suooesa in schools in the separate job clusters. 

During succeeding^ yean, various changes in composition of the Ab have been made, mostly by 
administrative Cat, sd tb^t at^' prraent timSlSe cur.'ent enlisted apdtude battery produces four Air 
Force AIs-Mechanical iM), Administrative (A), General (G), an*filectionic (E). Along the way, a great 
deal of research has heen done on the enlisted aptitudeJimery, but few studies questioned the 
effectiveness of the omcep^of M, A, G, and E aptitude-indexes or explored novel ways of weighting 
subtests to imduce the M, A, G, and E composites, this study addresses the utiUty of a different method 
^^^mghting (he M, A, Cund E composites. 

ilistoric^ly, subtest weighting has been acocmiplished partly by science and partly by artistry. 
Throu^ various multiple cofrelational tedtniques, an opdmuin weight has been deriv^ within eadi Air 
F<»ce »^iecialty fc« each subtest sc<»e against final technical schmd grade for that special^. Then the seu 
ot wei^ts for specialties have been scrutinized within a particular aptitude ak-ea (sa]r, M), looking for a 
minimal set ot ]Hedietors which consistently exfaifait posHive non-trivial weights across the entire area. 
When audi a set has been found (three w four predictors), the weigh*') aie all founded (o 1«0, and agmn 
multiple cOTreiation coeffidenU are commuted between school pades and these unit- weighted predictor 
variables to see if the validities are holding up after conversion from optimum Weights tp unit weights. 
Ordinarily, little is iM by converting to unit weighting (see Wainer, 1976). ^ 

^/ 

One problem* however, has been recognixed with this system. Different schools within aptitude 
area require different ^I leveh to qualify Jor entry. For example* some A schools require only a score of 
40th percentile for admission* while others require the 80th percentile. Both schools, however, gite grades 
on the same apparent scale, f rof- 10 to 100, ey^n though the A80 school b undoubtedly mu\h more 
difficult that the A40 school. Therefore* a final school grade of 82 would refer to I Iflier aftomplilhrnent 
in the A40 school than it would in the ABO school. When valtdifies are compyted and predictor weighu 
assif^ed across entire aptitude areas regardless df school level (seii? Figure4), soir ^ method is needW for 
adjusting scl^ool grades in individual schools upward or downward as a function of the prerequisite^ levels 
of ability (^40, A50, . . . AST). Such a method would ensure that graduates of A40 and A80sch6olt nave 
criterion si^res based on the s^irtte metric. In short* if it could be done* predictor weights for subj^esU 
would be more accurate, and Al scores could be computed which would be more evident than theyriire 
now. The problem, then* is how to estimate what the school grade of the A80 students would have been if 
they had taken the A40 course and if there had not been a ceiling score of 100 on school grades. 




A 
B 

C 



« Line of be^t lit for etdi levd.of ^cbooli 
« Lwe of bcti fit for entire i^tailc «re« 
■ A40 entmee prcr ey iatc 
* A60 entrance prerequieite 
- ABO entrance prereqniHte 



F^im h Schematic r^praeatctfoa ofilqirarfiig effect of rimlkr criterion 
range on oy^rall iraUditj eoefBdettt «»m|mted acroM 
school ^eqnlrittg dflSerent lerek of iqitf tttde. 



WbenieMledi^ tlmform« thepoblemaImoitTetolmit8c|f%heMdi^ionisto 
en ^adM to the icbool frad^ of A80 tiiuleBto to r^ect 

ni.An tdboottb Such a oMitam dionM unprofe the ittttatiofi in tl^ mann^ defni^ in Figim« 1 and Z. , 
c^Tlie eaa^illAiott of thii een^utf requires wly that the mean tdiool grade ^ the A40 school be known 
and thittan ci^BiNiie can be made of the mean idiool yrade Ihe A8D student would have earned if they 
hadallttded dM A40selml and if the 100 scm cetl^ were r^oTcd^Such an estimate can -be made 
leamdSf w^ hf eomp^if the bett.AI in the A40 

ii Aes iMtd lofiedkt die pedes ^ members of the A80 poup. Hie difference between the mean of the 
oiN»md cffilmfon gradee of Ae A40 group and ^ mean of the predicted grades of the A80 group 
inimdes'tfw required eonsttnt This cimsttnt is then added to tlH» mterion grade erf etch subject in the 
AM fpmef to pfor 4e a raw criterion metric w that grades of all studenU (both A40 and ABO) are arranged 
on ^ saaae ortterion scale. 

The formisla to derive the new criterion K score is as follows: 



Cj + (cj - eg) 



where 
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the tnii«fonned grade score of peraon j 
the obterved grade score of person j 

6 



% 

I 



100 



*3 jo: 




A 
B 

C 



tine of bek fit fist entire aptitude am 
A40 «ntmice prarequiiale 
A60 entrance prei:0(juiiite -> 
ASOentrtncej^rereqvinte ^ 



Figure 2. Schematk repreietttation of higher rMbtj (»>efflcieilt 
altainaUe^^erent leirel f>choohi are pb^ ^ t 
on Miii^Herhe^riita melrk by oddlng cottttanu. 

the mean of the conif^il^ «core8 generated for nXudtnU in the Base ^oup (the group 
in whichMhe prediction composite is generated -i.e., the A40 group in the above 
example). 

tf - the mean of the composite scores generated for subJscte in a Targ» • group 6y applying 
weights developed in the Base gniup (the Target group is the groap to which the 
criterion grade correction will be applied. In the above example. A80 would be the 
^ Target group). 

Wlwnthe scores on the K criterion have been computed, the sittation depicted in Figure 2 will have 
been achieved, and an adjusted criterion wilt have betwme available for use iii deveftping new weights for 
the available predictor variables. The new weights can be used to esUblfsh a new aptitude composite 
which may reasonably be expected to predict success throughout the aptitude area, disregarding level, 
better than any set of weighu computed in the conventional way. *< 

Two sets of weighu ire computed. The first set comes f^m predicting the actual grades on just the 
A40pwip and is done only as an intermediate step to determine the constant us^d to adjust the grades of 
UteA80|ro«p. The second set of weights comes frum predicting a combination of the actual grades on the 
A40 group an^ the adjusted grades on the A80 group. This second set'of weights defines the new aptitude 
eompoMle. ' *, 
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After ihe new.weights (ajgainst the K crilerion) have been established and coiiiposile aptitude sror*<5» 
have been cpmputed for ail students in the study, it is necessary to ch«*ck empirically to see whelher the 
new eomposites really do pfedic|, actual school grades better than do the old oues. The objective of ihi^ 
study was :o develop new weights for aptitude composites computed from K*rriterion scores for a sample 
of the population and to cross-apply these weights ta another sample. 



11. APPROACH 



Sample Population ' ^ 

The sample consisted of all airmen entering the j\ir Force between Januai < 1977 and Septembt. 
1979, on whom subtest and Al scores on Armed Services Vocational Aptitude Baiiery (ASVAB) Forms 5, 
6, or 7 and numerical technical training final school grades- were available. $chool3fai lures ^ere omitted 
from the safiiple, as well as all subjects in schools wl 're the total number cf graduates during this 2-year 
period wasiess than 50. Total N for the sample after all necessary deletions was 88,1*)9. Of these, 19,715 
ivere graduates of schools requiring multiple aptitude prereqJtkites (e.g., E80 and Mf>0^, and ()8,484 were 
from 119 schools with only a single prerequisite (e.g., A60). The f9,715 subjecte in schools with multiple 
prerequisites were arbitrarily called X, and all computations and dataTfumipulationi) applied to the M, the 
A, the and^e E subjecU were also applied to the X subjects (even though this group consisted of M, A, 
C, and E subjects intermingled). ' 

The subjects in each school were randomly divided equally into a computing (C) subsaniple and a 
cross-validation (V) subsample. Then, within each sitbsdmple, schools were combined to form the groups 
shown in Tabfe I. 



Table L Groupa by'Aptttude Area and by Entry Level 



Group 


N(C+V) 


Group < 


. N(C+V) 


Group 


N(C+V) 


M40 


8.395« 


G40 


3,530 


E50 


1,852 


M50 


8,079 


G45 


14,271" 


E60 


1,134 


A40 


7.259" 


C50 


154 


£80 


10,322" 


A50 


224 


C60 


8,710 


X40 


• 5.078 


A60 ' 


2,251 


C65 


121 


X50 


1,266 


A70 


205 


CBO 


773 


X60 


13,371" 


A80 


1,204 











'Bmc group. All olhen ar« Tarj^rl groups. 

Predictor/Criterion Variables 

The following va rubles were available (or we^e computed) on each subjecl: 

1. Technical schod ff^al grades* graduates only. 

2. ASVAB suhiest scorC'-Nimierical Operations 

3. ASVAB subtest score— Attention to Detail ~ - 



4. ASVAB subtest ^r^Word Knowledge 

5. ASVAB subtest ag^e— Arithmetic ReaiK>ning 

6. ASVAB subte&r score— Space Perception 

7. ASVAB suhlest score— Mechanical Comprehension ^ 

8. ASVAB s)d^test score— Shop information 

9. ASVAB subtest score— Auto Information < 

10. ASVAB subtest ^ore— Electronics Information 

11. ' ASVAB subtest score— General Information 

12. ASVAB subtest score— Math Knowledge 

13. * .ASVAB subtest score— 'General Science 

14. Mechanical AI, as conventionally'derived.^ 

15. Administrative AI« as conventionally derived.^ 

16. " General AI, |is conventionally derived.* \ 

17. Electronic Al, as conventionally denied.' , j 

18-59. Educational ^luriables. These variables were dichotomou/ scored I if the subject had 

^ surcesafully completed a specific public -school course* zero otherwise. 

60-64. Prediction composites CiM. CIA, CIG, CIE, and CIX, computed against the K 

criterion using only the ASVAB subtrst scores (Variables 2—13). 

65-69. Prediction composites C2M, C2A, C2G. C2E, and C2X,< computed againi»t the k 

criterion using the subtest scores and the educational -variables (Variables 2—13. 

18-59). 



Method 



The K criterion was computed in the C subaample of the M Base Group (M40 schoob), and applied in 
the Taiget Groups (only one in this case) of that aptitude area to get the cpnaUnU for correcting the final 
achool grades of each aubject so that all members of M schools were placed on the same criterion (the K 
criterion) metric. 

- ^ Thia procedure yielded a single criterion fw all members of the M aptitude area, regardless of level. 
The levej^.were then combined, and within the M aptitude area, another wis computed in ths C 
avbaamirie; thia one between the K criterion and the 12 predictor sublet scores taken as a a^ \ Using the 
weigfau emerging from thia exercir., a new Mechanical AI score (called ClMl^war^neratedToTall 
aubjecU in all croM-v>lidation subaamples (A, G, E, and Xjfaa well asMi^Thucompleicd the development 
of the CIM oompoiite. The aame procedure was repeated^in jbe^A^, G, E, and X groups to generate CIA, 
GIG, CIE, and CIX for all aubjecu. 

Tlie procedure deacribed in thewiBvious two paragraphs was repeated, this time using the 12 subtest 
plus the 42 educaUonaJvariafilei as the set of predictor variables. The prediction composites using 
all theae predictors werM^ignated as C2M, C2A, C2G, C2E, and C2X. 

Att^la^i^, three different aeU of AIs, or predictor compoaites, were available for comparison in the 
^[?iaa*fafidation sfiftple; namely, the four compoaites generated in the traditional way (M, A, G, and E), 
the five CI compoaites generated using the K criterion and the subtest scores only (ClM, CIA, CIG, CIE, 
and CIX), and the five C2 composites generated against the K t^iterion using the aubtest scores plus the 




'In this study. th« M. A, €. and E aptitude compwitw were recomputed and ueed tn raw icore (not percentile) form. Conversion 
proMemi wkli ASVAB 6 and 7 would noi affect the resulu of the Hudy. 
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* edudrtioiul TarUblet (C2M, C2A, C2G, C2E, and C2X). Validity comgAn80ii8\ere made ih the Y 

tolmiiiple between the tUndard AIs and the CI and C2 composites to' determine whether or not the CI ' . 
and/or compoaiten improved prediction of flnal school grades in individual i^choo^s, and if^so, how 
much improvement occurred. 

* t 
ill. RESULTS AND DISCUSSION ' * , 

Validity cosfficiento against school grades were^ computed within ^each of the 119 schools' The 
« uQcorreeted 'Validities of the Ak, the Cl o^mposites, and the C2 composites are shown in Tabic 2. The 

same validitic oorrKCted for attenuation by selection (Guilford, 1950, f rmulae f3.2^^nd 13.51, p. 349)* 
are shown in Table ^3. The following observations are obvious from T j|e 3: 

1 ' > : ' . ■ , 

!. Tliere is very^little differenife between the Cl and C2 composkes. Validities averaged (usin^R t^ 
Ftaher\ Z trap iormjifioR) i|croN ail schools were .5^ for the Cl Goinposites and .60 for the C2 composites. • 
To imfffove validities by an average of only .01 is not WoVth using 42 additional predictor variables* (the f 
education variables). For the rest of this report, comparisons will be ihade only between the conventional 
Ab and the Cl composites. ^ ^ 

2< There is w<Nlhwhile improvement, overall, in tht predictive efficiency of the Cl composites as 
compared with Ab computed in the traditional manner. As mentioned in the.previous paragrrph". the / 
ovmll average validity of the Cl composite, acmes all i 19 schools, was .59./nie average validity of the AIs 
' • acTW all ickoob was .50. It t j|d be noted, however, that the iraproveirmt in prediction usi'^^ the Of 
eompotitei raa^ not ht entirely attributable to the new way of computing th^ Cl coin|XMite«4 uning the K 
crite/ioo apfHWch. There were at least t^o other differences between the foimation of the tl^adittonal AIs 
and the Cl comptr es. First, all ASVAB subtests wer^uaed to fortn/the Cl composites, wKereas ohiy 
selected anbaets of subtest scores are' used to fcf^ the traditional Ab. Secohd, the subtest scores ' * 
comprimg the \b were unit weighted, whert as the Cl composite was formed by optimal weighting of ^ 
. ( ^'^'^ subtest scMtfes. Experience indicates that, in a croaa-vali^stion sample, optimal weights produce very ' ^ 
Kttle more prediction than unit weights and that, at Iritat in most situations involving a large predictor set, <^ 
only a very few^tariaUes have weifjhta-aignifiintttly different from zero. From a practical standpoin^. t^f 
Inipcftant fact is that compobite« ^jmpqted"ifribc.j!ianner of the Cl composites are' more efficient in 
predicting suceesa of airmen, ttut whatever reason. Still^lrilimportanl to understand more exactly wh) the 
Cl CKUpoaitea are superior to the AIs comf* jtsi in the usual maiiiiSf>4^*nAly8is of these dajta will be 
done to control for the variance ji^hich coald possibly be introduced«byo|niinal^ weighting and larger 
preiKctor sets in forming the Ci conposites. 

* * ^ - ♦ 

S. Tile validities of CllM, CIA, CIG, CIE, and CIX are all very similar, regardless of what is being 
« predicted. For example, there is very little advantage m using the CIM composite to predict success in the 
niechani<»l*area; CIA, CIG, CIE, and CiX all do about equally well. This is an interesting finding. It ^ 
seems to asgue that success in one area is similar to success in oth<;r areas. A)so« differential prediction by 
10$ Various ^^factm,'' which most researchers have been pursuing, may be, as McNemar sugge^' ^ 
(McNenuur, 1%4), larf^^y illusory. Certainly in this study, where no artificial controls were imposed on 
the sek«ction and weightinf of subtest score»« there is little to rhoose among the Cl M, A, G. and E ^ 
' compoiitea, whatever one is predicting. Average ^iiiidities of the various composites are given, by aptitude 

ar^, in Table 3. ' ^ ' ^ 

Larger diffrrrences appear among the M, A, G, and E Ab computed in the traditional manner, 
although the selenor composit^e is sometimes not the mos^ efficient one; probably because, in the past, 
i**ffffcrMxs among the Ab were sometimes forc^ even though some overall validity was lost. Even these 
eonvtnli<Ktal AIs, formed in a iheore tical framework rationally designed to maximirx differential validity, 
arc not generally very convincing in substantiating differential prediction as a practical goal of test 
construction. 
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Tabk 2. GbmptriMn of Uncorrected Validltico, Tlfrce Prediction 
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Composites AgainVt Technical Scho.il Final Grade'r ^ 



CwDvcnilonal 
Conpoalie* 



30 
43 
5^ 
49 
40 
39 
40 
22 
. 41 
45 
39 
35 
40 
73 
52 
41 
15 
It 
60 
46 
55 
29 
80 
19 
55 
36 
33 



46 
53 
39 
S3 
-03 
39 
40 
46 
33 
16 
29 
36 
30 
36 
37 

t 
18 

2S 



42 

21 

34 

25 

1^ 

28 

31 

25 

32 

01 

27 

29 

25 

32 

25 

17 

12 

13 

38 

27 

27 . 

27 

35 

64 

07, 

16 

^ 
34 



57 
28 

to 

30 

34 

50 

49 

45 

22 

25 

44 

44 

27 

46 

52 

38 

40 

36 

52 

09 

39 

SI 

45 

67 

31 

27 

S3 

51 



30 

37 

38 

58 

37 

21 

42 

32 

32 

26 

3i 

2<> 

37 

28 

11 

5^ 

21 

22 

58 

33 



55 
69 

70 
O'l 
32 
50 
52 
5S 
45 
SO 
1 46 
69 
51 
51 
37 
65 
47 
40 
66 
53 



55 
35 
34 
50 
48 
46 
41 
35 
%t 
W 

44. 

45 
*0 
51 

4^ 
38 
33 
40 
5^1 
50 
48 
54 
71 
17 
t7 
43 
42 



44 


27 


42 


t6 


34 


04 


41 




39 


38 


49 1 


42 


44 




60 ' 


52 


43 


46 


61 


H> 


* 37 


31 


48 


44 


21 




45 


45 


0& 


04 


20 


33 


38 


33 


65 


47 


20 


37 


i9 


28 


33 


40 


57 


45 


23 


26 


41 


31 


31 


43 


56 


44 


38 


06 


61 


%\ 


32 


28 


51 


42 



45 
53 
67 
61 
15 
47 
56 
55 
40 
43 
37 
44 
41 
45 
43 

12 
I 



C«mipiMjictf 



67 
44 
49 

62 

56 

59 

56 

52 

38 

48 

54 

56 

44 

56 

60 

57 

50 

33 

50 

69^ 

47 

59 

58 

79 

•7 

7 



55 



49 
55 
69 
62 
54 
42 
22 
60 
43 
55 
42 
45 



52 



59 

72* 

74 

66 

25 

63 

63 

62 

51 

56 

48 

65 

'« 

5' 

•4<> 

71 

Sj 

4.) 

6< 

5f» 



68 
37 
•4fr 
57 
44 
:>7 
55 
51 
39 
37 
50 
52 
V 
51 
50 
48 
42 ' 
36 
57 
*6 

to 

52 
5T 
71 
35 
44 
62 
57 



49 
53 

73 
63 
53 
50 

20 



60 
45 
^8 

59 

55 



59 
72 
73 
6f> 
33 
63 

6i 

S2 
18 
51 
73 

5j: 
55 

44 

50 

\:^ 

78 

53 



67 

43 

48 

61 

55 

58 

55 

52 

40 

46 

54 

56 

42 

55 

60 

55 

49 

29 

45 

68 

46 

60 

56 

26 

34 

60 

61 

54 

54 



48 

55 
68 
60 
54 
39 
19 
58 
-42- 



55 
40 
53 
56 



59 
70 
68 
65 
20 
65 
62 
61 
51 
56 
47 
64 
55 
SO 
45 
69 
55 
39 
62 
56 



68 

, 45 
4<. 
60 
53 - 
58 
55 
49 
36 
47 
53 
55 
.45 
56 
60 
55 
46 
35 
54 
66 
48 
55 
ol 
79 
39 
54 
58 
54 



69 
44 

47 

61 

53 

59 

56 

51 

39 

45 

53 

'56 

H2 

56 

57 

55 

47 

^5 

55 

64 

45 

56 

59 

78 

36 

52 

61 

5S 



54 54 



50 
52 
70 
63 
55 
47 
28 
60 
-42- 



51 
54 
71 
63 
55 
47 
23 
63 
-46- 



56 57 

42 U 

$6 57 

60 61 

53 54 



59 
70 
78 
67 
27 
62 
64 
62 
Si 
.55 
49 
M 
59 
53 
47 
74 
51 
38 
70 
51 



60 
72 
76 
67 
.10 
65 
62 

52 

57 

5<) 

70 

6() 

54 

47 

72 

S3 

12 ' 

76 

54 



r2 

CompoaiUa 



68 *^ 


68 


69 


70 


70 


50 


46 


49 


49 


51 


54 


48 


50* 


48 


53 


63 


55 


61 


60 


60 


57 


46 


5«i 


53 


55 


60 


56 




59 


60 


57 


55, 


54 


55 


57 


52 


48 


53 


49 


52 


40 


39 


43 


37 


41 


49 


' 37 


47 


17 


' 46 


54 


50 


54 


54 


54 


57 


50 


56 


54 


55 


42 


35 


44 


. 42 


41 


57 


50 


56 


57 


55 


61 


46 


59 


59 


56 


58 


to 


56 


55 


57 


49 


43 


• 48 


45 


46 


SI 


33 


28 


VK 


32 


51 


59 


4^1 


56 


58 


69 


34 


67 


"65 


65 


47 


36 


45 


48 


45 


59 


52 


59 


55 


56 


58 


54 


55 


61 


58 


80 


66 


76 


78 


77 


36 


33 


32 


38 


3f> 


57 , 


40 


60 


53 


52 


61 


61 


60 


58 


62 


55 


56 


56 


54 


55 



56 



51 


SO 


49 


52 


53 


55 


54 


57 


52 


55 


69 . 


69 


67 


67 


69 


60 


64 


59 


62 


6i 


52 


53 


52 


54 


53 


44 


53 


41 


47 


50 


25 


19 


20 


27 


20 


61 


6$ 


58 


61 


63 


45 


5S 


43 


45 


50 


54 


60 


55 


5^1 


57 


42 


45 


40 


43 


44 


56 


60 


54 


58' 


58 


57 


61 


' *7 


58 


60 



35 



58 


59 


59 


61 


61 


70 . 


70 


70 


70 


69 


73 


68 


68 


77 


75 


63 


64 


64 


67 


65 


28 


39 


M4 


30 


32 


64 


64 


68 


iA 




63 


5<» 


62 


66 


(»2 


62 


59 


62 


(»2 


(»4 


52 


51 


52 


52 


53 


57 


58 


58 


55 


59 


56 


•S3 


49 


50 


52 


r»4 


72 


66 


66 


71 


62 


H\ 


60 


63 


0^ 


52 


hi 


49 


53 


53 


K» 


19 


48 


l« 


51 


71 


67 


69 


75 


72 


5t 


19 


54 


52 


5' 


41 


(6 


39 


39 


43 


68 


72 


63 


67 


7 1 


57 


5> 


53 


49 


»5 













148 

54 
59 
311 
280 
1.700 
262 
141 
148 
341 
209 
2,295 
67 
'322 
48 
173 
165 
102 
48 
28 
99 
207 
142 
44 
49 
129 
200 
558 

8.229 



227 
198 
49 
149 
135 
112 
30 
72 
244 
•357 
3.345 
*623 



5.^ 



69 
93 
43 
88 
59 
44 
101 
185 
111 
433 
590 
59 



3% 



38 

35 



ERLC 



I.J 



1€ 



Table 3 {Continued) 



CiNiircclhiiial 




24 

27 
35 
49 
SO 
34 
*5 
16 
96 
21 
2S 
46 
31 



22 
22 
39 
3S 
«4I 
27 
51 
33 

a 

37 
41 
44 
24 



36 33 



35 
44 
56 
50 
52 
47 
55 
45 
54 
36 
45 
61 
39 

52 



28 
35 
43 
5C 
59 
43 
56 
28 
35 
21 
26 
50 
33 

44 



38 
47 
54 
61 
65 
51 
64 
41 
SO 
40 
48 
61 
45 

56 



CI 



58 
58 
61 
55 
67 
49 
54 
43 
50 
64 
48 



38 
46 
53 
61 
63 
47 
63 
37 
49 
41 
49 
60 
45 

55 



46 



65 



38 



* C2 
CompiMilet 



38 


39 


38 


39 


37 


39 


5.917 


47 


46 


46 


45 


46 


46 , 


1^18 


56 


55 


59 


54 


55 


57 


1.192 


60 


, 60 


57 


61 


59 


59 . 


130 


64' 


64 


60 


62 


64 


64 


92 


55 


53 


57 


49 


54 


58 


2^t 


67 


64 


69 


64 


68 


69 


113 


45 


39 


49 


37 


42 


44 


202 


52 


49 


58 


48 


48 


52 


53 


41 


41 


42 


42 


39 


44 


152 


49 


49 




50 


47 


50 


353 


63 


61 


62 


60 


62 


<y 


185 


47 


46 


52 


46 


47 


49 


m 


58 






'55 






13.772 




mm 




32 
22 
51 
65 
42 

a 

so 
45 
45 
so 

35 
44 
44 
36 

43 
42 
38 
44 

27 
52 
II 
37 
51 
39 
33 
63 
42 
57 
37 
44 
53 
38 
55 
SO 
42 
32 
48 
58 
61 
46 
45 
56 
52 
79 



I? 

38 
60 
36 
29 
46 
38 
38 
60 
33 
27 
49 
14 
32 

1? 

29. 

25 

38 

26 

24 

30 

27 

14 

48 

21 

26. 

30 

37 

29 

27 

17 

57 

34 

62 

29 

n 

15 
23 
52 
43 
31^ 
52 

35 



60 

37 

49 

83 

53 

46 

55 

56 

58 

66 

59 

SO 

S6 

38 

47 

46 

62 

38 

S3 

56 

53 

54 

43 

43 

36 

16 

47 

46' 

42 

53 

53 
2 
54 
41 

f& 
62 
65 
53 
SO 
52 
68 
St 
59 
62 

53 



57 

43 

57 

75 

49 

58 

U 

66 

87 

64 

48 . 

U 

63 

40 J 

58 

49 

67 
40 

53 
56 
65 
61 
63 

a 

41 
71 
53 
39 
4i 
60 
65 
57 
57 
63 
46 
61 
50 
73 
6t 
18 

54 ^ 
63 

55 ^ 
77 
57 

57 



66 
. 58 
63 
86 ' 
61 
62 

71 
58 
74 
54 
61 
69 
52 
57 
6S 
73 
48 
57 
66 
63 
60 

56 
49 
82 

57 
•.65 
56 
66 
70 

60 
67 
56 
65 
71 
77 
69 
44 
61 
73 
65 
82 
67 

6S 



68 
51 
61 
85 
59 
58 
64 
69 
58 
74 
56 
58 
68 
4» 
55 
98 
1$ 
45 
62 
6S 
60 
58 
60 
53 
46 
82 
55 
55 
52 
63 
66 
60 
44 
64 
SO 
71 
67 
75 
60 
35 
59 
71 
61 
71 
66 
% 

62 



68 
57 
63 
85 
60 
61 
65 
69 
56 
72 
52 
*S8 
66 
51 
56- 
6t 
69 
54 
55 
67 
59 
56 
61 
54 
46 
82 
54 
65 
55 
62 
68 
59 
56 
65 
54 
63 
70 
75 

m 

47 

58 
71 
65 
81 
67 

63 



^1-50 



^^lEtlil jtflii mil J ill it 111 fiiftf. . 
nftriwil ipQNilf hem tntitlffd ftnm (*orr«lclK^p 19 upper. 



66 


68 


67 


66 


67 


66 


67 


56 


56 


61 


51 


61 


62 


64 


6* 


64 


62 


57 


64 


64 


61 


86 


87 


84 


88 


83 


■7 
•f 


mm 

,00 


66 


61 


60 


59 


61 


63 


6r 


63 


62 


64 


U 


63 


68 


63 


67 




47 


65 


67 


67 


68 


73 




71 


68 


71 


74 


73 


60 






cm 

an 


«7 
91 


61 


60 


78 


75 


75 


74 


73 


77 


76 


84 


56 


55 


54 


53 


85 


55 


61 


62 


64 


57 


59 


62 


63 


78 


70 


71 


69 


69 


.73 


72 


SO 


52 


52* 


47 


52 


51- 


52 


87 


57 


.58 


55 


57 


$f 


58 


60 


63 " 


63 


57 


62 


62 


63 


77 


75 


' 72 


74 


70 


76 


76 


47 


48 


49 


39 


52 


a 


48 


61 


6} 


56 


54 


55 


50 


58 


65 


66 


65 


64 


64 


64 


64 


66 


64 


63 


59 


63 


67 


.65 


68 


61 


61 


58 


57 


63 


62 


1 M 


6<r 


67 


63 


63 


70 


7| 


56 


57 


^ 


57 


57 


60 


60 


49 


SO 


So 


46 


46 


81 


51 


88 


83 




74 


80 


80 


79 


58 


59 ^ 




52 


54 


58 


.^7 


68 


63 


67 


59 


68 


66 


66 


56 


56 


57 


SO 


55 


59 


57 


68 


68 


66^ 


59 


63 


69 




78 


71 


71 


67 


60 


74 


t 


65 




63 


59 


60 


67 


65 


• 60 




63 - 


47 


57 


65 


65 




67 


^ 69 


63 


66 


71 


71 


18 


55 


54 


47 


53 


55 


53 


69 


69 


67 


68 


65 


70 


70 


H, 


70 


71 


64 


69 


69 


69 


7f 


78 


77 


61 


75 


7i 


75 


a 


65 


70 


61 


71 


68 


67 


33 


37 


^ 42 


36 


46 • 


33 


36 


63 


62 


62 


58 


60 ' 


64 


M 


73 


74 


' 72 


68 


71 


72 


71 


65 . 


64 


66 


61 


66 


64 


64 


81 


.79 


83 


74 


82 


83 


82 


67 


67 


70 


71 


70 


70 


?i 


: ^ 


65 








67 


















> 5f 


N 






» 60 







82 

31 

92 

36 
143 
322 
121 
417 

72 

68 ' 

237 
1U» 
85 

159 
• 23l> . 
146 

43. 

29 

*m 

61 
245 
117 

m 

211 
3|«l 

36 
2M 
127 
236 
342 
317 
247 

33 

32 
122 

27 
18 

.16 
, 155 
1 15 • 
2M1 
76 
' lot 

6.6rt 



3$.;»n 



llMruidividual aptitade areM, tndivuhul feveU, <nJ individual whoob are couidered, th* K 
enienoo leduiiqiie findi even more utiUty. The average of Cl'compMite validiUes for M KhooU ia .55; the 
tvwiie o^^iiik^ial J ijptitade iiidw k .44 (aee Table 3). CIA averkgea .55 lor A achoola, whereaa the 
avenge Al-A a only ^ The average CIG (for Q ichoflS) ia .55, whUe the average AI-C it .52. Finafly, the 
avenge CIE la ooaapared with an average AI-E of .57. Certainly in the If and A arraa, the tl 
wmfoMtt an •opefior to the AI oo-npoaitea. In the area, th^ CI compoaite it sUghUy better than the AI. 
and in the Electronic area; the difference ii wdl worthwhile. 

I > ' . \ 

. The largeit improvement is obviooaly in tht A ichooii, and a cloee scrutiny explains why. Of the 13 A 
•chooMhe AI-A compoaite yields the least prediction of all the conventional AI <S>mp«iite8 in nine of 
them (M%). In fact, in every one of the'A schools, the conventional ALC appears to He a better predictor 
ihanAI-A. In no other aptitude area is this true. Takiiig into account that the A schools comprise 1 1.143 
sabjeels (a very large sample), the devel^ment of, a new Administrative composite .would seem to be 
worthwhile, even if the AIs continue to be computed in the conventional way. 

' . • 
Considering leveU witbin aptitade areaa, the Base group* (tha> group in which the weighu were 
dmved which were then applned to fhe target groupe) would be expected to produce higher CI validities 
than tbe T«get groupa because the eqnationa that were insirvmenUl in producing the K criterion were 
(tenved m the Baae gronpa. If the CI validities of the Base group am subsuntialiy higher than those of the 
Twfget groape/moK benefil would be expected /rom using the CI composite with schools at that level. 
Howev^, fho-evidence argues the opposite case. 

In the M area, the average AI-M validity for the Base schools is .45 and the average CI -M validity for 
these sdiood is .54, an increasd of .09. In the Tai|et schook (see Table 4), the average AI-M validity is .41 
•and the aven^ Cl-M is .56. in increase of .15. 



Table 4. Improvemeiiu ia Predietion by C2 Composites, 
Bw and Target Schook ComiMred 



0 






Svboob 


Tirgel 
Sthooia 




AI(M) 
C1(M) 




.45 

.54 


.41 

.56 




Difference 




.09 ^ 


.15 . 




AI(A) 
CI (A) 




* - 

.35 
'•54 

s 


.25 

.55. 




Difference 


i 


•1^ 


.30 




AI(G) 

CMC) 


i 


.40 ; 
.42 


.52 
.55 

IS » 




Difference 




.02 


.03 




AI(E) 

C1(E) . , 




.57 
.65 


4 

.56 
.66 




• Difference 




.08 


.10 • 



ERIC 



15 



.18 



I U the A ireii. th^avewfe Al-A validity in .35 for Ba«« groiip «cbook and average CI -A vahdity is .54. 
; a difference of .19. In the A area Target whooU. the average Al-A validity i».25 and average CI -A validity 

-r- Base eehoob prodaee an average Al-C validity of .40 and average Cl-C validity of 42 an 

. tm|WOve*ei.t of only .02. The Taiget whooB produce an AI-G validity of .52 and a Cl-G average validity 
; of .55^ an improvement of .03. ' 

s 

Overalt the average AM validity in the 8a«e groaps is .57. which increases to .65 (a 
i imprweffleni) when the Cl-E ^ponte i. awd. In the E area Target schook, the average Al-E validity h 
; ewipared with .'i6 far the Cl-E eomposite. an improvement of .10. 

fe smnmary. the CI composite produ^ more iwp«vement in the Target gchools in every instance 
J (thoa^ the effect i» .m«U i« the G area). Thi« »»alt U exactly the oppoaite of predictions, and the reawn 
j this effect »hotdd appear i» unknown. At aay rate, using the CI composite io the Target schools (rather 
I than »Jie Al composite), would be more advantageous than using them in the Base schools. 

There were very large^ differences among individual sdniois in the anu^nt of predictive 
im^emenl effected by the CI composite. These differences ranged from -.12 (school 231X1, G60) to 
+.53 (scho^ 7mi. A60). There was no increase in predictive accuracy in oply 12 of the 1 19 schocrfs. The 
r rahdflies ^ 45 schools improved at least .10 when the CI composite is substituted for the traditional AI 
, compoatles. 24 schodb improved at least .15. and 12 improved at least .20. dearly, there are m.:"v 
, tndividBal schools in which use of th^ CI composite could result in substantUd improvement in predictive 
r^fficwBcy. „ ' t . 

iV. CX>SCL(JSK>NS ANDREOHMHENDATIONS 

The information contained in this report leads to the following conclusions and recommendations: 

^ ^ ^ AoossMrfl schods, the method of pfoducifll the CI e^posita yields results snbstaotiafty better 
; »M^*^«»wameihodofp»di^ 

I nliditjr of JO, eon^ianfed wi* .S9pn>da^ By the CI CQmpesi*e«. The difference between the squareti of 
^ T^t^^^ »ifl»aeit» is .iO (^ minus ;2^, and prspKtieul im^ement (.10 J5> is .40. 
' J-* "*""^ f"^^**** *^ ^ pnsdfelive effieiency using the eoBventional AIs, a 40% 

j i«|WM^!m« ^ ^ to »W c<« he raad^ 

. eampeiWB. If CI cempopltes are oMtd to select kg tame but MM dl the schools, moch more dramatic . 

'"I^f^ ^^^^ **« A schools, 362X4, and 

{ v^^msg Ah ei^ttied in the tnditbnal nwiaer to some schools, and CI composiUis 

J «Ki^d as w this sualy to select for others i. not a se^ pohfem. The only additiona^rocedure 
I ittvrived would he the compnuitHn «nd recording for^eh enlistee of an additional set of composites-an 
} almort ttivi*! {soeediite ftw a cjusputer. . , ^ 

; 2. tW CS composite are nrt kb^ntiaffy imj^^oved by adding eduationai variables to the set of 
i stiMftit pK^etorf. V . 

i theptsaMry ^j«lfve of this study was not the evaltiatiofl of the predictive efficiency of 

; the «en»iliQial qXititde fndenes, the Adrainisteative AI. a* cuneotly censtkuled, shows up as such a 

forv fwscfaods i« Ae Administralivearea that this finding should be documented. Ascertainiiw 

this fitidieg shotrid be the obpprtive of future research on ASVAB «>mposites and if 

m^ueA, effofto sheidd be direct to the d^elopiaent of a new Administrative AI lo increase the 
.|^h!^ivtrvatidily,irf this composite. • > 



4. The K-compcwile procedure worked rather wll. It is a procedure which should be iisetul not only 
in the context described herein, bu2 also in acsdemic prediction stucKes involving grade po^t averages of 
frefihmcn, sophomores, junior** and seniors collapsed into a single criterion group. The procedure could 
also be used in studies predicling rating criteria collected on the same scale on subjects of different ranks 
and in other situations wh^e criterion data are collected across groupa of varying levels on scales 
restricted by arbitrary upper or lower limits. 
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